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1.  Participants 

•  Robert  Calderbank  is  an  expert  on  methods  of  limiting  the  end  to  end 
complexity  of  signal  processing  for  multiple  antenna  systems  so  that  it  is  close  to 
that  of  single  antenna  systems.  In  collaboration  with  Dr.  Howard  and  Dr.  Moran, 
he  has  provided  rigorous  methods  for  the  design  of  libraries  of  waveforms,  or 
more  generally  libraries  of  radar  modalities,  for  detection,  identification  and 
tracking  application.  When  different  waveforms  can  be  transmitted  independently 
and  coherently  from  different  array  elements,  waveform  selection  is  based  on  a 
generalization  of  the  standard  radar  ambiguity  function  that  describes  the  response 
of  the  radar  to  a  point  target  at  a  fixed  range  and  Doppler. 

•  Stephen  Howard  (DSTO,  Australia)  and  Bill  Moran  (University  of 
Melbourne)  have  been  involved  in  the  area  of  electronic  surveillance  and  radar 
for  the  past  ten  years.  Within  the  Defence  Science  and  Technology  Organisation 
Dr.  Howard  has  led  the  research  effort  into  the  development  of  algorithms  in  all 
areas  of  electronic  surveillance,  including  radar  pulse  train  deinterleaving, 
precision  radar  parameter  estimation  and  tracking,  estimation  of  radar  intra-pulse 
modulation  and  advanced  geolocation  techniques.  Since  2003,  he  has  led  the 
DSTO  long  range  research  program  in  radar  resource  management  and  waveform 
design.  In  collaboration  with  Dr.  Moran,  he  has  provided  rigorous  methods  for  the 
design  of  libraries  of  waveforms,  or  more  generally  libraries  of  radar  modalities, 
for  detection,  identification  and  tracking  application. 

2.  Activities  and  Findings: 

•  The  major  research  focus  was  the  relationship  between  new  ideas  in  classical  and 
quantum  error  correcting  codes  and  the  development  of  an  information  theory  for 
radar. 

•  We  found  that  the  m-dimensional  discrete  Heisenberg-Weyl  group  provides  a 
unifying  framework  for  a  number  of  important  sequences  significant  in  the 
construction  of  phase  coded  radar  waveforms,  in  communications  as  spreading 
sequences,  and  in  the  theory  of  error  correcting  codes  [1,2]  .  Among  the 
sequences  which  can  be  associated  with  the  Heisenberg-Weyl  group  are  the  first 
and  second  order  Reed-Muller  codes,  the  Golay  or  Welti  sequences,  and  the 
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Kerdock  and  Preparata  codes  [7],  which  are  non-linear  binary  error  correcting 
codes  containing  more  codewords  for  a  given  minimum  distance  than  any  linear 
code.  The  Kerdock  codes  are  associated  with  decomposition  of  the  Heisenberg- 
Weyl  group  into  disjoint  maximally  commutative  subgroups  [1, 2,  6,  and  7].  It  is  a 
surprising  fact  that  a  certain  general  class  of  Golay  sequences  exist  within  the 
Kerdock  codes.  This  had  had  previously  been  noted  by  Davis  and  Jedwab  [8]. 

Golay  sequences  [3-5,  8]  are  pairs  of  sequences  of  unimodular  complex 
numbers  with  the  property  that  the  sum  of  their  individual  auto-correlation 
functions  forms  delta  spike  or  thumb  tack.  These  sequences  have  found 
application  in  the  construction  of  radar  waveforms  and  in  modulation  schemes 
for  communications. 

•  This  project  led  to  the  creation  of  a  new  cross-functional  team  (Robert 
Calderbank,  Stephen  Howard  (DSTO,  Australia,  and  Bill  Moran  (Melbourne) 
spanning  the  application  domain,  classical  harmonic  analysis,  algebra  and 
combinatorics.  The  capabilities  developed  by  this  team  as  part  of  this  project  have 
been  integrated  into  a  larger  multi-institutional  response  to  the  task  specific 
DARPA  BAA  05-19. 

•  The  results  of  this  project  were  shared  with  the  mainstream  signal  processing 
community  at  ICASSP’05  (Philadelphia)  and  with  the  defense  signal  processing 
community  at  DASP’05  (Homestead,  Utah). 
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4.  Application  Value 

This  project  is  the  starting  point  for  the  development  of  algorithms  to  significantly 
expand  existing  radar  functionality.  The  appropriate  advanced  hardware  functionality 
exists  in  the  NRL  Chesapeake  Bay  Detachment  radar,  and  at  other  sites  in  the  US  and  in 
Australia.  This  facility  is  capable  of  high  levels  of  temporal  and  spatial  diversity  of 
waveforms  and  polarization,  and  the  mode  of  operation  can  be  rapidly  scheduled.  This 
project  supports  development  of  techniques  to  fully  exploit  the  diversity  and  flexibility 
provided  by  this  advanced  functionality  through  adaptive  multidimensional  waveform 
and  polarization  scheduling  based  on  environment  modeling  and  tracking,  as  well  as 
multi-dimensional  adaptive  processing  of  the  returns. 
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1  Background  and  Motivation 

Decision  making  in  military  environments  often  involves  complex  relationships  between  the 
decision  making  agents  who  must  cooperate  in  order  to  achieve  some  objective.  Typically,  deci¬ 
sion  makers  will  be  concerned  both  with  group  performance  (e.g.,  accomplishing  the  mission)  as 
well  as  individual  performance  (e.g.,  survival,  complying  with  assigned  duties).  In  many  realistic 
scenarios,  decision  makers  will  be  distributed  in  space  and  time  and  must  operate  without  a  central 
authority.  They  may  have  multiple  conflicting  priorities  and  will  need  to  proceed  without  complete 
information.  For  such  scenarios,  an  “optimal”  solution  may  not  be  well  defined,  since  optimal 
choices  by  the  individuals  do  not  guarantee  optimal  behavior  for  the  group  and  vice  versa.  Even 
if  an  “optimal”  solution  is  feasible,  it  may  be  based  on  assumptions  that  are  difficult  to  justify  or 
on  parameter  values  that  are  difficult  to  verify.  Nevertheless,  the  individuals  must  be  capable  of 
achieving  an  acceptable  level  of  coherent  and  coordinated  behavior  even  in  the  face  of  adverse 
circumstances. 

Satisficing  game  theory  (SGT),  which  is  summarized  by  Stirling,  Frost,  and  Miller  [28]  (which 
accompanies  this  White  Paper  as  a  supplemental  document)  as  well  as  more  completely  discussed 
by  Stirling  [27],  provides  a  new  theoretical  foundation  for  the  design  and  synthesis  of  artificial 
multiagent  systems  and  for  the  understanding  of  human  decision-making  processes.  This  theory 
stands  in  contrast  to  classical  decision  methodologies  that  are  based  on  optimization  (i.e.,  utility 
maximization).  It  is  a  mathematically  rigorous  theory  which,  although  it  employs  the  descrip¬ 
tive  term  satisficing,  is  very  different  from  the  theory  of  bounded  rationality  developed  by  Simon 
[21,22],  who  employs  the  term  to  describe  decision-making  that  achieves  a  heuristically  defined 
aspiration  level.  Satisficing,  in  that  sense,  is  an  approximation:  optimization  remains  the  ideal, 
but  the  cost  of  achieving  it  is  demonstrably  prohibitive.  Consequently,  satisficing  a  la  Simon  is 
philosophically  no  different  from  strict  optimization. 

Satisficing  as  defined  herein  is  a  mathematically  rigorous  alternative  to  optimization-based 
methodologies.  Rather  than  attempting  to  identify  (even  approximately)  a  single  “best”  solution, 
it  identifies  a  set  of  solutions  that  are  “good  enough”  in  a  well-defined  mathematical  sense.  The 
resulting  group  and  individual  solutions  conform  to  two  fundamental  social  axioms:  (a)  endogeny, 
which  stipulates  that  the  preferences  of  a  group  must  emerge  through  coordination  among  its  in¬ 
dividual  members;  and  (b)  social  coherence,  which  requires  that  no  subset  of  individuals  should 
be  categorically  required  to  forfeit  its  own  welfare  in  order  to  benefit  the  group.  These  axioms 
constitute  minimal  conditions  for  the  reconciliation  of  group  and  individual  interests.  By  con¬ 
trast,  optimization-based  solutions  do  not  comply  with  either  axiom.  This  concept  of  satisficing 
is  explicitly  designed  to  account  for  the  sophisticated  social  relationships  such  as  coordination, 
compromise,  negotiation,  and  altruism  that  may  exist  in  a  complex  society. 

SGT  derives  its  ability  to  account  simultaneously  for  both  group  and  individual  interests  from 
the  structure  of  the  utility  functions  that  it  employs.  These  utilities,  called  social  utilities,  are  con¬ 
structed  according  to  the  syntax  (but  not  the  usual  semantics)  of  probability  theory.  Consequently, 
they  permit  the  modeling  of  multiagent  and  multi-attribute  behavior  in  a  way  that  is  mathemati¬ 
cally  analogous  to  the  way  probability  theory  is  used  to  model  multivariate  random  phenomena. 
In  particular,  notions  of  conditioning  and  independence  can  be  adapted  form  the  traditional  epis¬ 
temological  context  (i.e.,  the  classification  of  propositions  in  terms  of  belief  and  knowledge)  to  a 
praxeological  context  (the  classification  of  actions  in  terms  of  their  efficiency  and  effectiveness). 

SGT  is  relatively  new.  It  has  not  yet  had  wide  exposure  within  scholarly  communities  that 
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focus  on  decision  theory  and  application,  nor  has  it  yet  been  subjected  to  rigorous  testing  that 
would  show  it  a  viable  means  of  decision  making.  However,  preliminary  (and  largely  unfunded) 
results  indicate  that  it  has  promise.  It  represents  a  true  alternative  to  both  classical  decision  theory 
based  on  expected  utility  maximization  and  more  recent  heuristic  approaches  such  as  rule-based 
systems,  both  of  which  have  well-known  limitations  [13, 17, 18,21,25,26,30], 

This  white  paper  describes  four  potential  research  agendas  that,  if  successful,  will  establish 
SGT  as  a  maturing  and  useful  approach  to  decision  making,  especially  in  group  contexts  where 
multiple  decision  makers  must  function  autonomously.  The  topics  associated  with  the  proposed 
research  agendas  are: 

•  the  further  development  of  multi-attribute  satisficing  decision  theory; 

•  satisficing  decision  making  under  conditions  of  uncertainty  and  ignorance; 

•  an  information-theoretic  analysis  of  satisficing  game  theory;  and 

•  psychological  evaluations  of  satisficing  decision  theory  as  a  model  of  human  decision  mak¬ 
ing. 


2  Multi-Attribute  Decision  Making 

Many  decision  problems  involve  the  consideration  of  possibly  conflicting  criteria  and,  in  order 
to  form  a  decision,  it  is  necessary  to  construct  a  tradeoff  between  the  various  criteria  that  results  in 
an  acceptable  compromise.  The  multi-attribute  decision  problem  is  isomorphic  to  the  multiagent 
decision  problem  where  each  attribute  corresponds  to  a  different  agent  under  the  constraints  that 
(a)  the  agents  have  a  common  option  set  and  (b)  they  must  all  make  the  same  choice.  Viewed 
this  way,  the  multi-attribute  decision  problem  is  equivalent  in  structure  to  a  social  choice  problem. 
When  discussing  multi-attribute  decision  issues,  therefore,  the  terms  “attribute”  and  “individual” 
or  “agent”  may  be  used  interchangeably. 

Many  algorithms  have  been  devised  to  address  the  multi-attribute  decision  problem,  including 
pair-wise  comparisons,  ranking  methods,  rating  methods,  weighted  sum  approaches,  strength  of 
preference  methods,  and  constraint  satisfaction  methods.  These  techniques  share  two  common 
features.  First,  they  are  based  on  some  notion  of  optimization;  that  is,  they  each  attempt  to  identify 
a  “best”  solution  according  to  some  criterion.  Second,  they  suffer  the  consequences  of  Arrow’s 
impossibility  theorem  [1],  namely,  that  it  is  impossible  to  formulate  a  ranking  of  group  preferences 
that  is  consistent  with  individual  preference  rankings.  Thus,  Arrow’s  theorem  guarantees  that  some 
of  the  desirable  properties  of  a  well-structured  decision  theory  will  be  violated  for  each  of  these 
methods.  For  example,  pair-wise  comparisons  are  easily  shown  to  violate  transitivity  and  ranking 
methods  commonly  violate  the  irrelevant  alternatives  condition.  Furthermore,  although  much  at¬ 
tention  has  been  devoted  to  the  development  of  methodologies  for  selecting  optimal  weights  with 
which  to  aggregate  disparate  criteria,  the  fundamental  arbitrariness  of  this  endeavor  can  lead  to 
paradoxes  and  inconsistencies  that  are  difficult  to  reconcile.  As  a  result,  even  multi-attribute  de¬ 
cision  methodologies  that  purport  to  be  prescriptive  (since  they  are  founded  on  some  notion  of 
optimization)  are  often  not  descriptive  of  actual  human  decision  making. 

In  contrast  to  optimization  based  methods,  satisficing  multiagent  decision  theory  [27]  is  not 
founded  on  optimization.  Instead,  it  is  founded  on  a  mathematically  formalized  concept  of  being 
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good  enough,  and  does  not  require  the  rank-ordering  of  preferences.  Consequently,  Arrow’s  theo¬ 
rem  does  not  apply  and,  by  means  of  the  theory  described  in  [28],  it  is  indeed  possible  to  reconcile 
group  and  individual  preferences. 

The  root  of  the  problem  with  conventional  approaches  to  multi-attribute  decision  making  is 
the  assumption  that  individual  (single  attribute)  preferences  can  be  formed  independently  of  the 
preferences  for  other  individuals  (attributes).  However,  individual  preferences  may  not  be  inde¬ 
pendent;  that  is,  the  value  of  a  given  attribute  may  depend  on  the  value  of  another  attribute  (e.g., 
when  choosing  a  place  to  live,  the  price  one  is  willing  to  pay  for  a  dwelling  may  depend  on  its 
location  relative  to  one’s  workplace).  Fortunately,  satisficing  decision  theory  is  explicitly  designed 
to  accommodate  such  conditional  relationships.  Furthermore,  it  is  also  designed  to  accommodate 
compromises  and  negotiations. 

2.1  A  Satisficing  Approach 

We  may  formulate  a  social  choice  problem  in  terms  of  satisficing  decision  theory  as  follows. 
Let  U  denote  the  set  of  options,  and  let  A  denote  a  collection  of  n  attributes.  For  example,  when 
choosing  a  place  to  live,  U  might  be  a  list  of  possible  apartments,  and  A  might  be  a  list  of  attributes 
such  as  distance  from  work,  rent,  size,  age,  etc.  Associate  with  the  ith  individual  in  the  group  a 
selecting  process  Si  that  considers  the  options  with  respect  to  achieving  that  individual’s  goal,  and 
a  rejecting  process  Ri  that  considers  the  options  with  respect  to  resource  consumption.  These  con¬ 
siderations  will  result  in  the  assignment  of  conditional  and  marginal  selectability  and  rejectability 
functions  which  will  be  used  to  define  the  interdependence  function  pSl~snRV-Rn-  Once  the  in¬ 
terdependence  function  is  formed,  the  joint  selectability  function  pSl...Sn  anc*  a  joint  rejectability 
function  pRv..Rn  may  be  formed.  With  these  functions  in  place,  a  satisficing  social  welfare  function 
may  be  defined  as 

Wg(ll)  =  Psy..Sn(%  •••,«)-  qPRy  -Rn(U,  •••!«)■ 

The  distinction  between  a  satisficing  social  welfare  function  and  classical  social  welfare  func¬ 
tions  is  that  the  former  is  an  endogenous  aggregation  of  each  individual  interests,  while  the  latter 
are  exogenous  aggregations,  that  is,  the  structure  is  imposed  by  external  sources.  The  advantage 
of  an  endogenous  aggregation  is  that  it  guarantees  social  coherence  in  the  sense  that  no  individual 
is  required  to  forfeit  its  individual  welfare  in  all  situations  in  order  to  benefit  the  group.  This  con¬ 
dition  seems  to  be  a  minimal  constraint  on  a  collection  of  individuals  in  order  for  them  even  to  be 
theoretically  able  to  reach  a  acceptable  compromise. 

Once  Wq  has  been  computed,  a  solution  can  be  obtained  in  several  ways.  Perhaps  the  simplest 
is  to  choose  the  option  that  maximizes  satisficing  social  welfare;  namely, 

u*  =  argmaxW0(u). 

A  more  sophisticated  approach  would  be  to  define  the  social  choice  set 

Tq  =  {u  e  U\Wq{u )  >  0}. 

If  the  social  choice  set  were  empty,  there  would  be  no  good  enough  choices  from  the  perspective 
of  the  group.  This  would  mean  that  the  interests  of  the  individuals  are  so  disparate  that  there 
are  no  actions  that  provide  a  net  advantage  to  the  group  —  in  other  words,  the  group  would  be 
dysfunctional. 


Also,  the  marginal  (individual)  selectability  and  rejectability  functions  ps.  and  pR.  may  also  be 
extracted  from  the  interdependence  function,  and  the  individual  satisficing  sets  may  be  computed: 

=  U:ps.(u)  >  qpRi(u)}. 

The  consensus  set  is  the  intersection  of  all  individually  satisficing  sets 

Cq  =  f]  E*. 

i= 1 

If  the  consensus  set  is  empty,  then  there  are  no  mutually  acceptable  alternatives  and  no  outcome  can 
be  pleasing  to  all  individuals  (i.e.,  the  attributes  are  so  disparate  that  there  is  no  way  to  reconcile 
them).  However,  if  the  individuals  are  willing  to  reduce  q,  then  eventually  both  the  social  choice 
set  Tq  and  the  consensus  set  Cq  will  be  non-empty. 

The  acclimation  set 

Ag  =  cq  n  r9. 

comprises  all  options  that  are  both  good  for  the  group  as  well  as  the  individuals  that  compose  it. 
If  this  set  is  empty,  then  no  choices  that  serve  the  interests  of  the  individuals  will  also  serve  the 
interests  of  the  group. 

2.2  Key  Research  Issues 

The  brief  formulation  provided  above  serves  as  a  point  of  departure  for  the  further  development 
of  a  comprehensive  theory  of  multi-attribute  decision  making.  In  addition  to  expanding  the  theory 
it  must  be  tested,  first  by  simulations  and  then  by  psychological  experiments  in  order  to  evaluate  its 
plausibility  and  viability  as  a  descriptive  model  of  human  multi-attribute  decision  making.  Thus, 
the  research  agenda  consists  of: 

•  a  detailed  theoretical  analysis  of  satisficing  multi-attribute  decision  making,  using  the  above 
approach  as  a  point  of  departure. 

•  Computer  simulations  of  multi-attribute  decision  making  using  real-world  scenarios; 

•  extension  to  the  combined  multiagent  multi-attribute  case,  where  each  agent  is  concerned 
with  multiple  attributes  :(in  this  situation,  the  goal  is  for  each  agent  satisfy  its  own  multi¬ 
attribute  decision  problem  in  a  way  that  also  complies  with  the  interests  of  the  group); 

•  psychological  studies  of  the  applicability  of  the  satisficing  model  to  human  multi-attribute 
decision  making  (See  Section  5). 


3  Decision  Making  Under  Uncertainty  and  Ignorance 

Decisions  must  often  be  made  in  an  environment  of  less  than  complete  knowledge.  This  lack 
is  manifest  in  two  ways:  uncertainty  and  ignorance.  Both  of  these  concepts  admit  degrees  of 
severity,  but  many  statistical  theorists  recognize  a  distinction.  Common  measures  of  uncertainty 
are  the  entropy  and  the  variance  of  a  distribution.  These  measures,  however,  are  typically  taken 
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with  respect  to  a  single  distribution  which  is  assumed  to  be  a  complete  and  accurate  description  of 
the  randomness  of  the  phenomenon.  If  a  single  probability  distribution  is  an  adequate  description 
of  randomness,  then  the  distribution  is  said  to  be  precise. 

Ignorance,  on  the  other  hand,  is  manifest  by  imprecision,  which  arises  if  there  is  not  a  unique 
probabilistic  description  of  randomness.  Imprecision  is  manifest  by  a  set  of  distributions,  with 
the  size  of  the  set  representing  the  degree  of  imprecision.  Sources  of  imprecision  include  (a) 
vagueness,  (b)  insufficient  resources  to  gather  and  process  information  in  order  to  define  precise 
models,  and  (c)  the  impossibility  of  reaching  a  consensus  for  the  description  of  random  behavior. 

To  account  realistically  for  incomplete  knowledge,  it  is  necessary  to  consider  both  uncertainty 
and  ignorance.  To  do  so,  we  first  consider  the  precise  case  and  then  extend  the  result  to  imprecision. 

3.1  Uncertainty 

The  classical  approach  to  decision  making  under  uncertainty  is  to  compute  expected  utility, 
where  the  expectation  is  taken  with  respect  to  a  probability  distribution  of  the  random  components 
of  behavior.  In  the  satisficing  context,  a  naive  approach  would  be  to  compute  the  expected  inter¬ 
dependence  function,  from  which  expected  selectability  and  rejectability  functions  can  be  derived. 
Such  an  approach,  however,  would  presuppose  that  the  epistemically  random  components  of  the 
model  would  affect  the  praxeic  components,  but  not  vice  versa.  Such  a  constraint  would  be  quite 
restrictive.  For  example,  suppose  the  random  component  is  due  to  the  unpredictable  activity  of  an 
opponent  in  a  hostile  engagement.  It  is  possible  that  if  an  agent  were  to  take  friendly  actions, these 
would  modify  the  actions  taken  by  an  otherwise  hostile  agent.  Thus,  it  would  be  wise  to  per¬ 
mit  two-way  coupling  between  praxeic  and  epistemic  components.  Fortunately,  satisficing  game 
theory  can  be  extended  to  accommodate  this  more  complex  model. 

Perhaps  the  most  profound  attribute  of  social  utilities  is  that,  since  they  conform  to  the  syntax 
of  probability  theory,  there  need  be  no  mathematical  distinction  between  praxeic  and  epistemic  at¬ 
tributes  of  a  system.  Furthermore,  graph  theory  provides  a  language  with  which  to  model  behavior 
in  a  way  that  emphasizes  the  local  interactions  between  entities  in  a  compact  and  efficient  way.  To 
construct  such  a  model,  let  0  be  a  set  of  possible  m-dimensional  epistemic  states  of  nature  that  are 
known  only  probabilistically,  and  let  S  and  R  denote  the  selectable  and  rejectable  processes  of  an 
n-agent  system.  We  proceed  by  constructing  a  graph  with  2 n  +  m  vertices,  with  m  of  them  corre¬ 
sponding  to  the  epistemic  states  and  n  corresponding  each  to  the  selecting  and  rejecting  processes. 
The  edges  of  such  a  graph  correspond  to  both  praxeic  and  epistemic  influence  flows. 

Consider  a  decision  problem  involving  a  group  of  two  agents  X\  and  X2,  and  let  {u\, . . . ,  un} 
denote  a  finite  set  of  possible  actions  for  the  group.  The  selecting  processes  are  Si  and  S2,  which 
view  the  possible  actions  in  terms  of  effectiveness  in  achieving  a  goal,  and  the  rejecting  processes 
are  Ri  and  R2,  which  view  the  possible  actions  in  terms  of  conserving  resources.  These  four  nodes 
constitute  the  praxeic  component  of  the  decision  problem.  In  addition,  suppose  there  are  also 
components  that  model  the  epistemic  uncertainty,  or  randomness,  of  the  group.  To  illustrate,  con¬ 
sider  the  two-agent  directed  acyclic  graph  (DAG)  described  in  Figure  1 ,  consisting  of  four  praxeic 
nodes  Si,  S2,  R\,  and  R2,  and  three  epistemic  nodes  9\,  02,  and  03.  Notice  that  the  praxeic  state 
S2  influences  the  epistemic  state  02,  which  in  turn  affects  the  praxeic  state  R\,  and  the  epistemic 
state  6\  affects  the  praxeic  state  R2,  which  affects  the  epistemic  state  93  and  the  praxeic  state  R\. 
Also,  the  epistemic  state  <93  affects  the  praxeic  states  Rx  and  Si.  Thus,  the  mathematical  struc¬ 
ture  (using  the  syntax  of  probability  theory)  permits  both  the  epistemic  and  praxeic  components 
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to  be  characterized  by  a  joint  mass  function  that  accounts  for  interactions  between  and  within  the 
components. 


The  epistemi-praxeic  interdependence  function  for  the  network  displayed  in  Figure  1  is  a  mass 
function  of  the  form 


Psls2R1R2e1e2e3{ui,U2,  Vi)V2,  02,  #3)  = 

Pk2  1 0l  (^2 1  1  )p01  (l?  1  )Pe2 1  s2  (^2 1  ^2  )p^3 1  «2  (^3 1  ^2 ) 

This  structure  seamlessly  combines  the  epistemic  (statistically  random)  components  of  a  multi¬ 
agent  system  with  its  praxeic  (action-taking)  components.  By  applying  standard  algorithms  such 
as  Pearl’s  Belief  Propagation  Algorithm  [20]  it  will  be  possible  to  compute  the  marginal  expected 
selectability  and  rejectability  functions,  where  the  expectation  is  taken  over  the  epistemic  variables 
6. 


3.2  Imprecision 

For  many  applications  it  will  be  impossible  to  specify  unique  influence  relationships  between 
the  selecting  and  rejecting  processes.  For  example,  it  may  be  only  possible  to  specify  upper  and 
lower  bounds  on  the  influence  that  one  process  has  on  the  other  persona.  Even  if  unique  rela¬ 
tionships  may  exist,  the  agents  may  lack  the  computational  ability  to  analyze  a  complex  body  of 
evidence  in  order  to  estimate  them.  In  such  situations,  reliance  on  a  unique  relationship  is  unwar¬ 
ranted  and  unwise,  and  it  would  be  prudent  to  represent  the  relationships  between  processes  by  a 
set  of  social  utilities.  In  such  cases,  the  influence  relationships  are  imprecise  Furthermore,  it  may 
also  be  true  that  the  models  for  9  will  not  be  precise. 

An  important  sub-discipline  of  probability  theory  is  so-called  imprecise  probability  theory  [3 1], 
which  is  concerned  with  making  statistical  inferences  that  involve  sets  of  probability  measures 
rather  than  the  classical  approach  involving  a  single  measure.  This  theory  may  serve  as  the  foun¬ 
dation  for  the  development  of  imprecise  praxeology,  where  the  social  utilities  (selectability  and 
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rej ectability)  are  imprecise.  This  approach  represents  a  natural  extension  of  basic  (precise)  satis¬ 
ficing  theory. 

Graph  theory  also  provides  a  convenient  language  with  which  to  characterize  imprecise  sys¬ 
tems.  A  set  of  probability  measures  is  called  a  credal  set  [14].  To  distinguish  between  the  classical 
epistemic  application  and  the  praxeic  application,  we  will  refer  to  sets  of  conditional  influence 
relationships  as  praxeic  sets.  Let  Vt  be  an  arbitrary  vertex  of  a  DAG,  and  let  Pv.  |pa(Vi)  denote  a 
set  of  mass  functions  of  the  form  pVi |  pa(Vi),  with  the  interpretation  that  each  such  conditional  mass 
function  is  a  valid  candidate  as  the  true  characterization  of  the  relationship  between  the  vertex  and 
it  parents  (here,  the  parents  may  be  both  praxeic  or  epistemic  vertices,  or  both).  Typically,  the 
set  Pv. ip^)  will  be  taken  to  be  convex;  that  is,  if  pv.lp „(Vi)  £  PVil pa(v.)  and  p'v.[p^Vi)  £  Py^vp, 
then  all  convex  combinations  of  these  two  mass  functions  are  also  in  the  credal  set;  that  is,  for  any 
a  £  (0, 1),  we  have 

aPVi\pn(Vi)  (1  —  a)Pvi IpafVi)  ^  ^VJ|pa(V5)- 

By  viewing  the  influence  relationships  between  vertices  as  praxeic  sets,  the  praxeic  network 
may  be  extended  to  include  set-valued  probability  mass  functions.  The  resulting  set  of  joint  mass 
functions  for  the  entire  network  is  then  of  the  form 

Pvv  -V2n+m  —  {HPv4|pa(Vj):  PVjlpafVi)  G  PV.\ pa^)}- 

i 

3.3  Key  Research  Issues 

•  A  unique  feature  of  this  approach  to  multiagent  system  modeling  in  the  presence  of  uncer¬ 
tainty  and  ignorance  is  that  it  proposes  to  deal  with  both  concepts  within  the  same  mathe¬ 
matical  structure,  namely,  graph  theory.  Furthermore,  this  approach  combines  both  praxeic 
and  epistemic  issues  into  the  same  unified  approach.  However,  extended  study  of  such  net¬ 
works  has  never  been  undertaken,  and  there  is  much  to  learn  about  the  potential  of  such  an 
approach.  To  assess  the  performance  of  this  methodology  it  will  be  necessary  to  develop 
simulations  of  potential  applications  of  real-world  military  interest,  including  such  potential 
applications  as  reconnaissance  and  surveillance,  team  formation,  intelligent  guidance  and 
control,  and  resource  allocation. 

•  The  study  of  credal  networks  is  a  current  research  topic  for  several  theorists  [6, 9-1 1 , 29, 32], 
One  of  the  major  difficulties  associated  with  credal  networks  is  that  the  number  of  vertices 
of  credal  sets  that  are  combined  tends  to  grow  very  fast,  due  to  the  number  of  combinations 
of  vertices  that  must  be  considered  in  order  to  define  the  credal  sets.  The  current  technol¬ 
ogy  in  dealing  with  credal  networks  can  effectively  deal  with  non-densely  connected  credal 
networks  consisting  of  approximately  two  dozen  precise  vertices;  beyond  that  only  approxi¬ 
mations  are  available. 

One  promising  approach,  which  has  been  applied  to  a  related  problem  by  Morrell  and  Stirling 
[19]  is  that  of  set- valued  Kalman  filtering,  where  a  convex  set  of  probability  distributions  is 
propagated  via  Bayes’  rule  and  dynamic  system  updates  to  produce  a  set- valued  estimate 
rather  than  the  usual  point-valued  estimate.  The  key  to  that  approach  is  to  parameterize 
the  credal  sets  and  propagate  the  parameters,  rather  than  the  entire  set  of  estimates.  This 
approach  has  lead  to  a  tractable  solution.  A  potentially  fruitful  avenue  of  research  would  be 
to  apply  the  same  concept  to  imprecise  praxeic  networks. 
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4  An  Information-Theoretic  Analysis 


Satisficing  game  theory  (SGT)  provides  a  coherent  mechanism  by  which  agents  and  Xj  can 
coordinate,  but  it  does  not  yet  indicate  the  robustness  of  that  coordination  to  changes  in  agent’s 
valuations.  We  propose  to  develop  quantitative  measures  of  agents’  commitment  to  their  various 
options  and  design  methods  which  exploit  these  measures.  For  example,  if  Xt  and  Xj  can  find  an 
option  u  that  is  both  jointly  and  individually  satisficing  and  to  which  both  are  strongly  committed, 
one  can  expect  the  resulting  coordination  between  them  to  be  robust.  If,  on  the  other  hand,  the 
commitment  of  either  agent  toward  option  u  is  small,  coordination  may  be  intermittent  or  otherwise 
unreliable.  Similar  considerations  apply  to  negotiation  and  group  formation.  If  mutually  satisficing 
solutions  cannot  be  found  and  the  commitment  of  the  various  agents  to  their  existing  individually 
satisficing  sets  is  simultaneously  large,  this  may  signal  that  further  negotiations  will  not  be  fruitful. 
Better  in  these  circumstances  to  either  change  strategies,  abandon  negotiations,  or  in  the  case  of 
group  formation,  to  exclude  certain  agents  from  further  consideration. 

To  develop  such  measures,  we  propose  an  information-theoretic  approach.  Information  theory 
(IT)  makes  use  of  scalar  measures  such  as  entropy,  the  Kullback-Leibler  measure,  and  mutual 
information  to  characterize  the  relationships  between  the  probability  mass  functions  (pmfs)  which 
represent  the  input  and  output  signals  of  a  communications  channel.  By  doing  so,  the  effects  of 
channel  noise  and  interference  on  communication  performance  can  be  obtained.  We  propose  to  use 
such  measures  to  study  to  what  degree  agents  can  modify  their  own  and  others’  decisions,  that  is, 
the  content  of  their  satisficing  sets,  by  changing  their  selectability  and  rejectability  utilities  within 
the  constraints  imposed  by  the  overall  system.  Unlike  IT,  where  the  signal  and  channel  pmfs  have 
only  an  indirect  effect  on  the  design  of  error  correcting  codes,  the  selectability  and  rejectability 
pmfs  directly  determine  the  satisficing  set,  and  we  expect  these  methods  to  apply  immediately  to 
the  design  of  SGT  systems. 

4.1  Review  of  Entropy  and  Mutual  Information 

The  entropy  H{Z )  of  the  univariate  random  variable  Z  with  pmf  pz  is  defined  as 

n 

H(Z)  =  H(pz)  =  -  'YjPz(i)\ogpz{i).  (1) 

i=  1 

In  IT  entropy  is  interpreted  as  the  prior  uncertainty  of  the  value  taken  on  by  Z.  Alternatively,  it  is 
the  average  information,  or  reduction  of  prior  uncertainty,  produced  by  the  observation  of  Z.  The 
mutual  information  between  two  random  variables  Z  and  W  is  defined  as 

I(Z;  W)  =  I[pz\Pw)  =  H(Z)  -  H(Z\W)  =  H(W)  -  H(W\Z).  (2) 

I(Z ;  W)  is  the  average  amount  of  information,  or  the  reduction  of  prior  uncertainty,  one  can  ob¬ 
tain  about  the  value  taken  on  by  one  random  variable  by  observing  a  different  random  variable. 
I(W]Z)  is  a  special  case  of  the  Kullback-Leibler  measure  D(pwz,PwPz),  which  in  this  case 
measures  the  ’distance’  between  the  joint  pmf  pwz  and  the  product  of  marginals  pwPz,  or  equiva¬ 
lently,  between  the  conditional  pmf  pW\z  and  the  marginal  pw. 

The  channel  capacity  problem  of  IT  is  to  determine  for  a  given  channel  pz\w  the  input  distrib¬ 
ution  pw  that  maximizes  I(Z ;  W).  Channel  capacity  defines  the  highest  rate  at  which  information 
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may  be  transmitted  across  a  channel  with  arbitrarily  high  reliability.  The  rate-distortion  problem  is 
to  determine  for  a  fixed  pw  the  quantizer  Pz\w  which  minimizes  I(Z;  W),  subject  to  a  constraint 
on  the  accuracy  with  which  Z  represents  W. 

4.2  Application  to  Multi-agent  Decision  Theory 

In  the  praxeological  context  H(ps)  is  interpreted  as  the  indifference  of  the  selectability  process 
S,  and  H(pr)  as  the  indifference  of  the  rejectability  process  R,  to  their  options.  Similarly,  the 
analogue  to  mutual  information  is  mutual  influence.  Thus,  for  example, 


I(Si\  Si)  =  H(Si)  -  H(S,\Sj)  =  H(Sj)  -  H(S,\S,)  (3) 

is  the  change  in  Si ’s  a  priori  indifference  caused  by  consideration  of  Sj ’s  indifference.  As  with  mu¬ 
tual  information,  mutual  influence  is  symmetric:  each  agent  influences  the  other  equally,  and  con¬ 
ditioning  never  increases  average  indifference.  Identical  conclusions  hold  for  I(Rp  Rj),I(Sp,  Rj ), 
and  I(Ri\  Sj). 

The  satisficing  set  £*  is  determined  by  the  likelihood  ratio  A.t  =  ps{ /qpip .  For  a  fixed  q  and  pRi , 
there  is  a  region  7Zq(u)  of  the  probability  space  such  that  option  u  £  E*  if  and  only  if  pg.  6  TZUu). 
The  satisficing  region  lZxq  associated  with  the  satisficing  set  Eq  is  defined  by 

k  =  n  <4> 

(The  satisficing  region  may  also  be  defined  in  terms  of  q  and  pgt .)  Because,  speaking  geometrically, 
Ps{  is  not  generally  equidistant  from  all  boundaries  of  7lq,  the  options  u  £  E*  are  not  equally 
susceptible  to  modification  by  adjustments  in  q  or  by  the  influence  of  other  agents.  Define  the 
selectability  commitment  of  agent  i  at  level  q  to  option  u  as 

Clq{u)  =  min  D(pSi,p*).  (5) 

p*&vq 

The  selectability  commitment  measures  the  minimum  change  in  selectability  required  for  an  agent 
to  eliminate  option  u  from  its  satisficing  set.  We  also  define 

Cl{u)=  min  D(pRi,p*).  (6) 

P*£K'q 

to  measure  the  minimum  change  in  selectability  required  for  an  agent  to  include  option  u  in  its 
satisficing  set.  Definitions  for  rejectability  commitment  are  similar.  The  goal  of  robust  design  is  to 
maximize  the  minimum  commitment  of  the  coordinating  agents  to  the  desired  option  u. 

Because  of  the  various  and  complex  ways  agents  may  interact,  we  do  not  expect  this  to  be  a 
trivial  problem.  For  example,  if  X  is  perfectly  indifferent  to  its  options,  so  that  both  ps  and  pn 
are  uniform,  then  Cq(u)  =  0  V  u.  If,  on  the  other  hand,  ps  and  pr  are  quite  different  Cq(u)  can 
be  quite  large  for  some,  but  not  necessarily  all,  satisficing  options.  Note  also  that,  although  large 
indifference  in  both  selectability  and  rejectability  implies  a  small  commitment,  small  indifference 
does  not  necessarily  imply  large  commitment.  Consider  for  example  psr{u ,  v)  =  0  for  all  but 
one  option,  so  that  H{ps)  =  H(pR )  =  0  and  X  is  not  at  all  indifferent.  If  that  option  lies  on 
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the  diagonal,  i.e.  pzSR(u,  u)  —  l  for  some  u,  then  ps(u )  =  pR(u )  for  all  u  and  C\(u)  —  0  V  u. 
Thus  X  can  be  conflicted  by  strong  but  offsetting  opinions  about  the  selectability  and  rejectability 
of  option  u  and,  despite  its  strong  views,  be  completely  indecisive.  Although  these  behaviors  are 
intuitively  satisfying,  they  complicate  the  design  problem. 

Now  suppose  that  X{  is  not  coordinating  effectively  in  some  setting,  and  we  wish  to  eliminate 
option  u  from  £*  so  as  to  make  Xt  more  deferential  to  agent  Xr  Consider  X/s  average  ability  to 
persuade  Xj,  that  is,  to  change  Xj’s  satisficing  set  and  therefore  its  decisions.  For  all  options  for 
which 

Cig(u)>I(Si-,Sj),  (7) 

Sj’s  influence  on  St  is  insufficient  to  eliminate  u  from  £*.  Similar  conclusions  can  be  drawn  about 
the  influence  of  Rj  on  Si,  or  about  X/s  ability  to  have  X*  add  u  to  its  satisficing  set.  The  design 
problem  here  would  be  to  design  ps^Xj  so  as  to  achieve  the  desired  coordination. 

4.3  Key  Research  Issues 

Although  much  remains  to  be  done,  further  analysis  along  these  lines  promises  to  lead  to  a 
better  understanding  of  the  limits  of  coordination  and  to  better  design  methods.  We  propose  to 
focus  research  efforts  on  the  following  problems: 

•  A  more  thorough  and  detailed  exploration  of  the  relationships  between  indifference,  mu¬ 
tual  influence,  and  commitment,  and  their  generalization  to  continuous  action  spaces.  A 
connection  to  the  treatment  of  decision  problems  in  mathematical  statistics  is  particularly 
warranted,  and  the  use  of  alternatives  to  the  Kullback-Leibler  measure,  such  as  the  Jensen- 
Shannon  measure  [15],  may  allow  a  compact  representation  of  the  simultaneous  effects  of 
SjRj  on  £* . 

•  The  development  of  numerical  design  methods  which  account  for  agent  commitment.  First 
efforts  will  be  based  on  modifications  of  the  well-known  Arimoto-Blahut  algorithm  [8]  for 
computing  channel  capacity  and  rate-distortion  curves. 

•  Computer  simulations  to  test  the  effectiveness  of  these  design  methods. 

•  Psychological  studies  to  test  the  relevance  and  accuracy  of  the  model  of  commitment  to 
human  decision-making. 


5  Psychological  Studies 

Decision  making  is  a  central  activity  of  the  social  and  behavorial  sciences,  philosophical,  and 
engineering  disciplines.  As  described  by  Simon  [23],  these  approaches  fall  generally  into  two  main 
categories:  substantive  rationality  and  procedural  rationality.  Substantive  rationality  is  normative, 
and  focuses  on  why  decision  makers  should  reach  conclusions,  and  procedural  rationality  is  de¬ 
scriptive  and  focuses  on  how  decision  makers  should  reach  conclusions.  Typically,  substantive 
rationality  is  implemented  by  maximizing  expected  utility,  and  is  the  basis  for  game  theory  and 
optimization-based  methodologies.  Procedural  rationality,  on  the  other  hand,  is  typically  imple¬ 
mented  by  invoking  rules  and  heuristics  that  have  been  shown  by  observation  to  be  valid  charac¬ 
terizations  of  behavior  in  similar  circumstances. 
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5.1  Satisficing  Rationality 

Substantive  rationality  and  procedural  rationality  represent  two  extreme  concepts.  The  former 
is  an  expression  of  the  superlative  degree,  where  decision  makers  seek  the  globally  “best”  solu¬ 
tion  according  to  an  explicit  quality  measure,  and  the  latter  is  an  expression  of  the  positive  degree, 
where  decision  makers  seek  a  “good”  solution  without  invoking  explicit  measures  of  quality.  Sat¬ 
isficing  decision  theory  provides  a  decision  methodology  that  lies  between  these  two  extremes,  and 
represents  the  comparative  degree  in  the  sense  that  two  utilities  are  invoked  to  establish  that  the 
attributes  that  favor  selection  of  an  option  are  “better”  than  the  attributes  that  favor  its  rejection. 

There  is  considerable  colloquial  evidence  to  support  this  concept  of  decision  making.  Peo¬ 
ple  routinely  compare  the  pros  versus  the  cons,  the  upside  versus  the  downside,  the  pluses  versus 
the  minuses,  the  benefits  versus  the  costs,  etc.  This  way  of  making  decisions  is  more  primitive 
than  a  total  rank-ordering  of  options  (superlative),  but  is  more  sophisticated  than  simply  following 
heuristic  rules  (positive).  Although  the  economic,  psychological,  philosophical,  and  engineer¬ 
ing/computer  science  literatures  are  replete  with  discussions  of  the  two  extreme  notions,  they  are 
relatively  silent  regarding  this  notion  of  comparative  decision  making.  Yet,  the  idea  of  viewing  an 
action  from  two  perspectives  —  one  that  focuses  on  the  positive  consequences  of  adopting  it  and 
another  that  focuses  on  the  negative  consequences  —  is  a  powerful  concept,  and  one  for  which 
both  psychological  and  mathematical  analyses  are  long  overdue. 

Studies  in  behavorial  economics  are  providing  an  increasingly  compelling  body  of  evidence 
that  (a)  humans  often  are  not  utility  maximizers  and  (b)  people  are  motivated  by  social  concerns  as 
well  as  by  individual  concerns  when  making  decisions  [4, 5],  Consequently,  the  neoclassical  ap¬ 
proach  to  decision  making,  especially  in  group  settings,  has  been  called  into  question.  Much  work 
has  been  done  to  incorporate  social  issues  such  as  fairness,  inequity  aversion,  kindness-reciprocity, 
and  social  welfare  into  standard  utility  theory.  [2,3,7, 12, 16]  The  fact  remains,  however,  that 
standard  utility  theory  is  explicitly  designed  to  facilitate  expected  utility  maximization.  Social 
utilities  as  defined  in  the  context  of  SGT,  on  the  other  hand,  are  explicitly  designed  to  accommo¬ 
date  social  issues,  and  therefore  may  be  better  than  standard  utilities  for  as  a  vehicle  for  testing 
social/psychological  attributes. 

For  example,  a  potential  application  of  SGT  is  as  a  vehicle  with  which  to  describe  and  analyze 
the  interaction  between  tribal  groups.  Each  tribe  may  have  its  own  set  of  cultural  values  which 
distinguish  it  from  others,  but  economic  imperatives  require  the  tribes  to  interact  with  each  other. 
As  they  interact,  the  possibilities  for  cooperation  may  prompt  them  to  coordinate  their  activities 
for  a  common  greater  good,  such  as  forming  a  centralized  government.  Or  they  may  choose  to 
remain  separate  and  pursue  their  own  parochial  interests.  A  well-known  game-theoretic  model  for 
intergroup  behavior  involves  the  so-called  Stag  Hunt  game  [24],  a  multiagent  game  in  which  the 
players  can  choose  to  cooperate  to  hunt  stag  or  can  defect  and  hunt  hares.  Considerable  analysis 
using  conventional  game  theoretic  approaches  has  been  devoted  to  this  game.  SGT,  however,  may 
provide  a  theoretical  setting  that  is  more  amenable  to  modeling  social  relationships  than  classical 
game  theory  provides. 

5.2  Key  Research  Issues 

SGT  is  a  new,  mathematically  rigorous  approach  to  multiagent  decision  making.  It  is  increas¬ 
ingly  the  focus  of  studies  designed  to  investigate  its  performance  and  computational  characteristics. 
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Although  these  preliminary  results  are  encouraging,  there  is  a  strong  need  to  perform  detailed  psy¬ 
chological  studies  to  test  the  hypothesis  that  satisficing  decision  theory  is  a  valid  model  of  human 
social  behavior. 

Two  desiderata  will  guide  the  research  program  proposed  here: 

1 .  the  identification  of  non-zero-sum  games  that  include:  (a)  provision  for  repeated  play  in¬ 
volving  two  or  more  players;  (b)  a  measurable  pair  of  attributes  suitable  for  instantiation  in 
the  selectability  and  rejectability  processes  of  SGT;  and  (c)  the  potential  for  instantiation  in 
a  face-to-face  situation  as  well  as  situations  in  which  players  compete  against  each  other  via 
computers  or  against  computers; 

2.  a  comparison  of  the  performance  of  SGT  against  at  least  one  other  model  vis-a-vis  the  data 
from  specific  games  in  a  way  that  establishes  the  models’  comparative  success  in  accounting 
for  the  data  (e.g.,  outcomes  consistent  with  the  predicted  satisficing  solution  sets  in  the  case 
of  SGT). 

•  The  first  component  of  the  program  will  be  an  extensive  and  systematic  review  of  the  extant 
literature  in  behavioral  economics,  which  is  a  loose  consortium  of  microeconomics,  cogni¬ 
tive  and  decision  sciences,  behavioral  psychology,  social  psychology,  anthropology,  political 
science,  philosophy,  etc.  The  review  will  focus  on  (1)  existing  non-zero-sum  games  that  meet 
the  criteria  described  above  and  (2)  mathematical  models  suitable  for  comparison  to  SGT.  In 
addition  to  identifying  existing  games,  the  review  will  also  identify  procedures  that  could  be 
adapted  to  become  game-like  and  involve  two  or  more  players.  Such  procedures  might  well 
be  found  in  the  experimental  literatures  dealing  with  attention,  memory,  pattern  recognition, 
problem  solving  and  decision  making,  contingency  perception,  impulse  control,  cooperation 
and  other  prosocial  behavior,  etc. 

•  The  second  component  will  consist  of  the  design  and  implementation  of  several  game  pro¬ 
tocols  derived  from  the  review.  The  protocols  will  represent  a  range  of  behavioral  and  cog¬ 
nitive  variables,  a  range  of  degrees  and  types  of  social  interaction,  and  a  range  of  number 
of  players.  In  each  case,  the  validity  of  the  protocol  will  be  established  by  a  panel  of  ex¬ 
pert  consultants  who  will  attest  that  the  protocol  is  adequate  to  provide  and  measure  the 
model-specific  variables  of  interest  and  thereby  supply  the  comparative  analysis  of  models, 
including  SGT,  described  above.  TThe  final  component  of  the  proposed  research  will  also 
draw  from  the  review.  A  subset  of  game  protocols  will  be  identified  as  suitable  implementa¬ 
tions  of  the  category  of  social  interaction  known  as  negotiation.  Subjects  in  the  research  that 
uses  these  protocols  will  be  carefully  selected  to  provide  three  types  of  game  scenario:  (1) 
the  players  all  share  the  same  ethnic  background,  and  (2)  the  players  are  from  different  ethnic 
backgrounds.  This  design  will  allow  a  cross-ethnic  (each  different  ethnic  group  is  indepen¬ 
dently  exposed  to  the  same  protocol)  as  well  as  multi-ethnic  (subjects  from  different  ethnic 
groups  are  brought  together  in  the  same  protocol)  analysis  of  the  comparative  performances 
of  the  models. 
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